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0 2 0 @! 

[£JA^?S] 6 m 301,000 

imm 332,000 m 

[g^AHW] 1. S^AH- SA||AH(£S)_1S 2.SXI01l2J5!gCH^(<M^^Ah^oj 01 | 
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#Efl cflolEiofl tfl^- o]Al _2.-ff«- ^ Al7 ] 7l 

^ ^ ^^Rr HMMS] #EJH cfl-§-^ 7p§^-& t^^ZL 

S.^ t^o]B] ^ °±*\ $\o)B\o\) -§-^ <^ ^ ^Kg. tro^V ^ ol^ #Efl ^f- j£ 

M^^r ^^^rS ^*Kr #7fl; #7l ^^f-^Ml 2]*fl £1 
5L#*}^ #7fl; * ^71 a.*! 3XJ- 5 fnlE| ^lofl oJ-b} A o >Bfl 7 }#*1 ^^Kr #711-1- 

£ 1 

#31 7>#*1 , #sfl^, ^ -g-f 
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-*Efl sJ-f- ^ {METHOD FOR MODIFICATING STATE} 



£ bSr £ <a] ^*HH o]*V av^ a-- wj-^ o. ^^ #£> 

£ 2^ SIG# °1 .§-*!- Aj-Efl 7}^^1 ^^-g: M-e}-^ nsflH, 

£ 3^ SIG+WL-i- °1 A o v ^ 7>^*1 q-El-Hfl ZLEflH, 

£ 4^ LIN* °1 -§-*!- A J"Efl 7 r ^*l t+Ej-yfl ZLHflH, 

£ 5^ LIN+WL* ^"Efl 7}-^*] ^ig-§- v+eI-VB ZLSflH. 

^Ml*l -M^l 

<6> ^-i^o. ^ ^ ^ ^o\] ^ ^-§1, MCE ^ Sf^^l ^"Bfl 7} 

$}o)K]o\) cfltb ^-S-* ^l^>7l ^*}^ _2.<>1^ ^>-§-*>^ 7> 

<?> ^yl^o.^, -grH p>^h (Hidden Markov Modeling)^: -g-^ <el^HH ^ 
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-i^-a- -SL^^Kr HMM ^Bflsl ^-i ^ ^£.3. ^^1^14. oje^V #3) §J-f- 

£-5. ^3 «o v ^^-S.^l 7H> ^5] A>-g-5]^ ML(Maximun Likelihood) M iHMt}. 

<8> ZLEiM-, ML ^ ^ tfl *V ^ ^ ^r^TT ^o] 

^"^Hl^i ^ ^"1- H^7l £jg O] ^o) 

GPD(Genernalized Probabilistic Descent) ^JH^IfMl 7]^Y^V MCECMinimum Classification 
Error) ^ol^r. 

<io> MCE ^ 7)^2) r-flolE^ ^ *^Wr 5L^* <2^r ?M ^5 ^JI 

^ ^azfl- ^sfl^i HMM^ ^ efl o] b] 1- ^--g-^ ^ojtq-. ol^> MCE <£Jlii)#* Q^S] ^ 

*$f>}JL o\]z] &^r°\ ^-^^<y M-Bfifl^ a^sj- ^^ofl cfl^ ^^tr^f. S*h MCE 

o-tg: £ |o] ^^£7]- >M<*JM Bi^^(mixture) 7>^*1 , sg^, ^ HMM 7) 

*tf. MCE «o v ^^ «o v ^AS^l HMM ^Efl SJ-f-oj] ifl^sfl oi^ ^# a>o1^ 

MCE £3 7]^^ ML ^£ 7)^3f »£3J*H ^«fl^li 91°.^ ML £3 ^°ll ^€ 
HMM^cf o.^^. ^^g_ jy.oicf. 
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<n> 7l^-^<y HMM 7) *l 2) -S-^ <y^ 7 HH, 3flEH o]Alo. #2fl ^ ioi] cfl*V 



tf-g- ^-ol ^s^i}. 



<12> 



r r 



g/ (X;A)= I N4i,ft + log6^( X/ )j + log^ 



(0, 



[*r*M i] 



.(0 
<7o 



<13> 



<14> 



cf^^ ni^^ (mixture) 7>-f ^of HMM°)1 *| fe- , #Bfl £i*r £t}. 



<15> 



M 



2] 



<16> 



°W oil N(-)£" 4^ o> ^ £ S 7l^H ^ j, 

(mixture) nHM^ sg-g- ^jE^olji ) £/~:s=. ^ j _ (mixture) nHl*!^ ^tg^o]cf. 

<17> oia ^ofl Cfl<5}c*} ( #2fl>, ^ fl-^o] A>-g-£]^ oj^ ^ X oll tfl^ #211^ C(X)fe 

C(X) = C, i = arg max (X; A) 

3] J 



<18> 
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^ ^^V: 2003/12/13 



<19> 



<21> 



rf / (X;A) = -g / (X;A) + log -i; £ exp^ y (X;A)7] 



<22> ^7loflA^ a ^ o o to] ^o]ji N *- N - b est .2.°!^ feflifs] 7fl^o]cf. §fl 

<23> ^Bfl^ o.o]^1 ^J-c*) ^o]5}cf. 



<24> 



5] 



/ t (X;A) = /( t /(X;A)) 



<25> o]?l <y<^ o] ol^l 3^ *r 51 0.14 iL» 

(sigmoid) A>.g-slcf. 



<26> 



1(d) = 



1 



6] 



1 + exp [->•</ + <9] 



<27> 
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<28> D>x|nl-_0 S _ ) o.Ajofl Ufl^ 0]A1 7 1 ^ ^8r ^ ^Ajlg-^*] 3§7>^CK 

M 

/(X;A)= Z // (X; A) 1(X e Q ) 

<30> <^7HH, i^l^K indicator) tHr^i}. 

<31> ^*}o] 2.^ 5fef Dl E| ^ 3§^- ^^s. ^ £ cfl 5 |.^.nl Ei ol uj ^ -g- ^ 

s)-^>7l GPD ^Jl^#o] ^ AV-g-^cf. GPD ^JLE]^ cf^-^ ^-o] ^o^tf. 

<32> 

8 > A " +1 = A " " £ » v » V/(X; A) 

<33> 

<^7H]a^| ( u^- ^1, B ~fe 4)-^ wl^: 2:^2] 3.7l(step size) 

<34> GPD <g3.^£r *\m 7l#olcf. ne^u)-, ij-f- £^o] HMM ^2 

«• ^1^1-71 ^^Htt <Hn^ ^ 2^1 ^cH^o>nV *Vcf. ^tft *\}<*2i^ GPD <^J1 

AV-g-^ c^Aiofl GPD HMM s^l^l ^ -g-*}^ cf. nfEj-n] e^ ^ 3\- 

^ **HM ^iltlr afl^^l o^o.^ <£a] ^7jo^oj t^A] HMM ^l^^o] 

£H°> W. 4^-4 ^ HMM E^ cfl*l ^l^^ol ^A] ^#6|H sq^o) ^-cf. 

<35> 

I-^VAi 9] Zjdij =1 fl"^ fl,y >0, I*c yA =1 W c yit >0, a jk! >0 

<36> ^ ^ ^HH<3j H}-E}.DlEi *flol= 3^1 -g- ^A]7l7l ^*1H Cf-g- Al^ 
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<37> 




10] 



a fj - -> where a t j -e 0 I 

c jk ~> Cjk where c jk = e Cj 

Mjkl -> Mjid =Mjkl /<7jkl 
°jkl -> <5>/ =logcr yyt/ 



ZL&IM-, ^ZLnflt (segmental) GPD <£jie|#<i 7) hJ^V MCE M^<Hl ^tt ^ 

3 ^1-8: HMM-i- ^*Rr ^sHE^l cfl^ Tfl^o] Jl^S]*} , ^-§1, # 

4lAl7l7l ^ ^ ^ ^^Kr HMM^ ^-Eflofl tfl-g-*Kr 7>^^11- £ 

*1» #^1^ ^£ cHojE-1 ^ o]Al c-flolE^] cfl*> o.^ o]M ^ ^>o. - ol 
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<4o> a o v 71 ^^o. ^§> 7 ) ^gj-o] ^. aveh sm- Ji3 ^£r, ^^h** °J 

33tt sflig-g- <y^*Kr #31; fHflit £3*Hr #31; ^"71 #Efl 

^ ^<H 4€- ^ ^-8: M-eW1S=- *8^a«-*r* «J^*H=- #31; ^7} 

^ofl o^fl sq-eHEH-S- 5L#*Hr #31; £ 5.t 4^)^ ^Hl 4^ ^-efl 7>^^1 



°1*>, £ t^l ^T*Rr 7l#^-0>oflA^ ^fi] *l^-§; 7>^1 7>7> £ ^ ^ 7 ]^^ A ># 

■i- -§-°l*}31 ^ oi^- ^^*>7l 3sH 7H V ^*H1 

£ l^r ^3 <g ^Al^ofl ^ ^-Efl SJ-t- a.^ «o V ^-i: M-^^ ^^ifESAl, o] 
£ ^-Bfl Ji^ u o v ^<Hl ^*}# ^tj-. 

#*1, ^^r* -g-^^ 3fl€-i- °J^*WS110). ^7lA^ ( HMM ^-Efl # 

3 lM*fl Ql-g-*>7l ^<5}H ^ #Efl^ 7>^^11- £31 ^ # 

M7fl5l HMM# 7fl7fl ^ o]Al cj^- j 7fl o^ ^-Efl^ ^^tJ-JL 7>^^>7>. 71^- 

°m #^fe S^r #<H 3.^1 Af-g-^cf . Et, ^-f-^<y HMHHfe #efl^ iofl 

tfltb ^■ 1 i^7> lofl ^^sl^ -R->M-*M] ^"Bfl 7>^ HMM^l^l #2fli iofl cfl*V 

^71 ^-^f-^fe 4-g- ^^\o\] o]Sfl ^o|^cf. 
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<44> 



g/(X;A)= I&og^ +4 /) iog^ /) (x / ) 



11] 



+ Iog;ri 



(0 



<45> 



<46> n * , °m -g-^ofl cfl^c^ #sfl>, ^fl-^ 3-§-t!-4(S120). ^, ^ ^ HL^ & 

<47> -l Aj- 7 1 tslio] o.ol^lcHl ^e} ^ olAl ^^-i- i^EHfl^r ^^f^r* 

cf(S130). 



<48> 



^, ^^^M] eq«fl 2.^ 2)-e}-PlEi^-g- £#^(S140). ^, ^7^ IS. 



^ ^"71 2.^ s)-e}DlEi^ i^^cf. 



<49> 



wy } («+i) 



i2] 



} -4t/(X; A) | (0 (0 



^, -g"^ ^ #3 ^ ^ 7}#^m *>7l +\°\) *\)<*S\o]o}: 



<51> 



13] 



>1 



J, 0 < Wy < J 
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<S9> 

<53> fiS, SL^i -±\o\] ^ 7}^x) S>J1(S150) , #7} <M 

^14. 



<54> 

w 

[*r*HI 14] 



<55> — 

<56> 7B^1*] ^71^ IS. -M^^ ^ &t}. 

<57> ^aVa] o.^, MCE J2-°J^€ °l-g-*H ^M^i <5>iElS 

MCE ^€<H1 ^f, 5l<^£]^- cflolE^ <#o) u}JjL ^cf^ tiME|ofl cfl^V 4 

3-§- ^-^171- cilolE^ d)o]El A>ol^ o]Al ^i-o} ^oj 7 l- ^S}?H 

$\$\ SL°m ^5Lt ^*>^ ^cHH S-^t^ 7>^^1# ^ ^.o] 

^ 351 oil 3 ^- io]Al S-^-^Jl o]^ ^ ^ &q*t ^ 

oi^*v s^jg jooiai 35: = s^(sigmoid) tfl^^S^I (sigmoid) o}^ ^ 

#*r# *r -§-^ ^H^s] ^-frM 7>#^11- ^ cltfl^r ^o]M ^ 
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<58> 



^(X;A) = -g.(X;A) + log 



l N r i 

J . 2 expt y (X;A) 7 ] 



d i (X;A) = d i (X;A)-kg i (X;A) 
- = -(l + ^)'g,(X;A) + log 



15] 



I N r n 

- Z expty(X;A) 7 J 



<59> 



^H^, k^b ^7>5L C]*i)^r ^-1-^ T^l^olJl ^ GflolE^l cfl*V i^-S- ^ 

7>a]^ ^jn £-aJo] £ ^ofl cfl^j- hmm sj-^ojE^] cfl*l ^ 7 >X| 



HMM^ Aj-tfl ^ j^-j- ^ o.^ olAlo^ A^ ^Aj-^ 5g 7 >^7l ^ ^7>^-# 

°l-§-tr ^l^rSS^. ^ ^c7>^- DBb S-§-^ A>^-^ ^-g-sl£_o^ 500^(^ 

250^, <^ 250*3 W ^^SSul, 400^ 200*3, 200^)^1 ^ °] ^ 

°fl A>-g-s)^ji 100^ 50*3, qjQ 50^)2] -§-^o] oiAiofl A>-g.£)&£J-. -^^MH^ 

11.025KHz DSP JilEL >5HHS] ^ 91^7} ^«fl>H 16KHzS 11.025KHz 

S cf-g- Afls^^4 jl^ rf]Ei^^ log 13*} cepstral 31^, 13aV IaV 

13*} 2a} *l^r ?J|^* o}-g-S}o} ^ 3iS^, 39a}- If-*J «3]Ei# ^^cg^ # 
#^ S^l- 8 (mixture) 7}^- a) o} A>-g-s>^cf. tiflo]^ ej-o] aj 

%£lsL»\ ML £3 HJ"^°fl 3 7flo] a o v^ ( 3 7fl ^ ^eei, 87fl ^ i2i ^ (mixture)^ 

S.t-3: ^^«rSl^. HMM 7>^A]# ^*Kr oZf^oflA} ^.o]Al ^.g. 7}l^>7l ^*fl 37fl^ 7 }# 
^ajo] ^H^l- A}-§-S}^t}(N=3). 

21-13 



1020030052682 



#3 2003/12/13 



<6i> *3^°IH^ 47}-^ ^ ^ 2^^o\) 7 }o]i£ o]^l ^ f-^, _2_<yAi 

3-E°ti 7)ol*V o]£ ^ %V^ > ^.ojAl S]-^ _£o)Al a^)* Aj-g-^c^ HMM 7)^- ^-5} 

MCE °1*1 ^l*>SSt}. ^7] & l£r ^ *\)o}B\ oj^l-o] ^Ufl7f S]^ 

* ^£ ^ <?1^ ^] o] b\ o\] cflt!" °J^!-8: M-E^ ^ojcf. ^5i^ #4^1 4^ * 

°1tt ^H^(ceptral) 31^<H1 ^ #3) « $3.7} *3 UMbH) 43-§- £^7}-^ ^<y^§- 

<62> [ S 1] 



Data 


MLE 


SIG 


WL+SIG 


UN 


WL+LIN 


Training 


98.40 


98.58 


98.58 


98.58 


98.71 


Testing 


98.00 


98.00 


98.00 


98.00 


98.00 



SIG : sigmoid loss function, LIN : linear loss function 
WL : weighted likelihood of correct class 



HMM 71^ -g-^ ^7HH HMM 7^1 1- ^^}r £-f£ ^ *%7\M: ^*fl 

A 1 47>*1 ^ A>-g-s><^ HV4*>^ ^^^-ofl 4= o]Al ^^o) ^.g. a] 
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<64> is. 2] 



Data 


MLE 


SIG 


WL+SIG 


LIN 


WL+UN 


Training 


98.40 


98.54 


98.54 


98.44 


98.56 


Testing 


98.00 


98.17 


98.58 


98.00 


98.50 



< 65 > £ 2^ (sigmoid) ^ *>-8-«H ^4*1^ ^ ^ OH 

Ei^ <y^-& ^S)-!- iL^^^f. £-^-§- «H^°ll ^2} ^ulofl^ ^ C-fl o] e^ ^) #7>^r> 

3 W iL°m- MCE *^<H1 A>-§-S|ir 01 ol Ei ofl cfltb °J*H ^1^1:^ 

7> ^Hfl^# iL^cf. £ 3^ k=0.0059j tfl^ -g-^1^1 7} 

¥<H $L°m z^SLM: (sigmoid) ^ tf^r* £^ 

ofl 4= ^1-^ ^Sl-l- iL^tf. HV4*Vo]l rcfE} OH^ o]^# C-l-i-c^ 0]Al 

< 66 > £ 4 ^ k-0°] ^ ^ ^"^r* ^-3] 7>^^11- ^^*V ^^Hr ^£ 01 

oIb] * <y^i OHE^l cflsflAi oj^ oi^ o]ai ^ eu 0 >t iL°=^l M-E^Hfl^-. £ 5 

k=0. 0059J -g-^ofl cfl*V -g-i^Sl ^t-SJHl 7>^*]* <^^^] 3.3.^ 

4d3 ^ *}~g-SH S^tt 01 o] Ei <?1^) 01 ol E^ ol] cfls>o^£ oj^-^ 

<67> ^ ^K^*! ^ S-Tgo] f^i.#oH 7>^^H1 £^ CflolE^ 
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<68> is. 3] 



k 


0.001 


0.002 


0.003 


0.004 


! 0.005 


Training 


98.54 


98.63 


98.48 


98.67 


98.56 


Testing 


98.17 


98.25 


98.25 


98.25 


98.50 



^"Efl 7>f^H Ufltb #3 ^ D]« ^ (l +k )Ufl n>^- f7}A]^ ^ Jl 

fr^fe <2-fr ^7> fltj-. 



HMM 71^ -g-^ °m *]^<%*\ ^d\) tfltb 7>^*1# 
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1] 

^t^r* -g-^^ o]ai^ #31; 

#71 #efli^ ^>go)l 4^ ^ tl^ ^^8: M-Hftfl^ #31; 
A oM £.<i 5|-e}nl Ei Aiofl aj-^ 7 >#^ ^*Hr #31 

^•i- ^ ^-Bfl sJ-f- ^ w o v^ 

2] 

^7l #Efli^l ^^ofl 4^- ^ °J^1 M-El-ifl^- Jg^-g^* ^*Rr #31 

1 — 

-§^3 3 iS^fi] S^SHl 7^*11- ^o] o.o]^l &i=-Q <t 

3* ^^-S. *}^r ^"Efl ^ Ji^ « 0 >^. 
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m 
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l^^ty 3] 

-8-71 #1% 7W*}2) 3^7} IS. ^^S]^ 

3# ^ ^"Hfl Ji^ 



4] 

3# ^-^.S. €r}^ #Efl ^ « 0 >^. 



5] 

-5-^1 S^r o]^ ^ ^ AV 7 ] Aj-Bfl 7>^*lfe- ^A] *fl 

^3-2.3. ^"Bfl ^-1- « 0 >^. 

[^T 1 * 6] 
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^8-2.3. ^Efl SM; Ji^ « C V^. 
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[S. 1] 





IS 







c 



j. 



S1 10 



S1 20 



S1 30 



S140 



S1 50 



3 



[5L 2] 



98.6 
98.6 
98.4 

£ 98 
| 37.5 
| 97.6 
97.4 
97.2 
37 
Sfs.8 



4 5 5 7 
Iterations 



-!/ airing data testing da to j 



8 9 ! 
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IS. 3] 



sa.8 






i 








! 


98.6 

S8.4 

X 96.2 
o 

I 98 

97.6 




A: 






S..6 
97.4 










1 


2 3 4 s 6 r e 

Iteration 


i 

9 I 



[51 4] 




"training data 



-tasting data j 



[£ 5] 





93.7 




98.6 




98.5 




98.4 




98.3 


\ 

5 


98.2 


8 


98.1 


< 






98 




97.9 




97.8 




97.7 - 



5 6 7 
Iterations 



10 



-training data testing data 
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